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ABSTRACT 

Consider  the  regression  model  Y*  -  g{x*)  ♦  e*  i  *  1,  2...n.  X*’s  are  unordered  design 
variables,  g  unknown  function  defined  on  [0,1].  {e*}  i.id  r.v  with  mean  0  and  finite 

moment  of  order  p  >  1.  The  asymptotic  behavior  of  estimator  gn  are  studied 
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We  consider  the  regression  model 


Yf-  g{Xj*)  ♦  6j*  i  -  1,  2 . n  (1) 

where  Xj*  e  [0,1]  are  unordered  design  variables.  6j*  are  iid  random  variables  with  zero 
mean.  g(x)  is  an  unknown  function  defined  on  the  interval  [0,1].  The  problem  is  to 
estimate  g(x)  through  observable  variables  Yj* 


Denote  ordered  design  variables  by  Xj  <.  x2  <...  <xn,  and  define  Yj  *  Yj*  and  e{  *  ej* 
if  Xj  »  Xj*  and  6n  *  rpax  ^(Xj  -  Xj_  )  where  Xq  ;  0,  Xn+1  *  1.  An  estimator  proposed  by 
Lin  and  Cheng  [1]  is  given  by 


8nW  *  l  Yj  J  a-’k  ( dz 
i*1  xi-1  n 


(2) 


where  {an}  is  a  sequence  of  positive  constants  converging  to  0.  as  n  -*  <*>,  k(z)  is  a  kernel 
density  satisfying: 


(i)  M2)  >  0; 

(ii)  k(z)  *  0  for  z  t  [-  L.L]  for  some  positive  constant  L; 

(iii)  J^MzJdz  -  1. 


In  fact,  it  is  obtained  by  the  natural  estimator 


h(x)  * 


x  <  x, 

Xj  <  x  <  xj  +  1 


i  ■  1 . n  -  1 


(3) 


after  smoothing  with  weight  function  a^k[(x  -  z)/a n],  Lin  and  Cheng  [1]  discussed  the 
strong  convergence  of  gn  and  the  rates  of  uniform  convergence  under  a  condition 


E|  e*|p  <  *.  p  >  2  among  other  conditions  In  this  note  we  relax  the  restrictions  on  the 
moments  of  e*  and  improve  the  results  of  [1]  and  12].  The  results  are  given  in  the 
following  theorem: 


Theorem  Assume  that  k(z)  is  bounded.  E|  e*|p  <  «  for  p  >  1,  6n  *  0(n-1),  an  »  n_{1 
for  0  <  d  <  1  -  If  g(x)  is  continuous  in  [0,1],  then  for  all  x  c  (0.1) 


gnM  •*  9W  a  s.  (4) 


Proof:  Denote  6j  -  ejlfl  e(  |  <  i1/p). 


n  Xj 

gn  *  £  J  aZ 1  k  ( -  )  d2  .  where  l(  )  is  an  indicator  function.  Then 
i*1  xi-1  8n 


9n(x)  -  g(x) 

-  gn(x)  -  gn(x)  ♦  gn(x)  -  £gn(x)  *  Egn(x)  -  Egn(x)  ♦  Egn(x)  -  g(x) 

A 

■  ♦  >2  *  >3  ♦  U 

as 

In  the  following  we  prove  lj  ■*  0,  i  ■  1,  2  and  ij  -*■  0,  j  *  3.  4  separately.  First,  when  n 

is  large  enough 

«4  -  Eg„  -  g  -  \  g(Xj)  J  '  dz  -  g(x) 

i*1  xi-1  n 

a  l  J  '  Ig(Xj)  -  gtzHa;;1  k(*^-I)  dz 
i*l  n 

n  Xj 

+  l  J  tg(2)  -  g(x)]a“1k(Sg^-?}  dz  (6) 

i*1  xi-1  n 


By  the  uniform  continuity  of  g(x)  in  CO.  1 3  and  the  property  of  k(z),  the  first  term  above  ij 

less  than  e  / 1  i—  k  f  x5~  — )  dz.  where  e  is  arbitrary  positive  constant.  The  second  ternr 
'0  an  k  an 

in  (6)  is  not  greater  than 


sup  I  g(z)  -  g(x)  |  ♦  i  sup  |  tk(t)  |  P  I  g(z)  |  dz 
z-x|<5  |t!>a“ 


♦  sup  I  g(x)  I  J  5  k(u)du. 

X  U 


So  it  is  easy  to  see  when  n  ■*  ® 


l4  -  0 


by  Holder  and  Chebyshev  inequality. 


I  '3  I  <  l  E<l  «i  I  Kl  0j  I  >  i1/p)>  Jx‘  ,an1k  dz 

i*l  1-1  n 

n  1  1 

<  a-’SnIIMI  l  tP(!«j|  >  i1/p)]1_p{E|  e(  |P)P 
i-1 

n  1  11 

<anl5nHMI  l  7T-I  (^1  «jlP)1p{E|  «i  lP)P 
i»1  1  P 

n  1  i 

±c»n'*nl - r<  cii’5nnP  +  °.  "  -  *  <8> 

i-1  ,1-i 

where  ||  k  ||  ■  sup  |  k(x)  |,  c  a  constant.  Notice  that  if  1  <  b  2,  we  have 
x 

ez  <.  1  ♦  z  *  |  z  |b  when  z  <  1,  so  if  r.v  Zj  <.  1,  EZ,  *  0  then  E(exp{Z,})  <  exp(E|  Zi  jb). 
Now.  take  b  <  p,  dn  *  *nnin£nn.  Zj  *  dn(Sj  -  E04)  J*'  ^a^k  ( x8~  z- )  dz.  By  the  choice  of 
dn  and  the  conditions  on  6n  and  an  in  the  theorem  we  know  that  Zj  <.  1  when  n  is  large 
enough.  Thus,  we  have 

n  n  n 

E(  n  exp{Zj} )  •  n  E(exp{Zj})  <  H  exp(E|  Zj  |b) 
i*1  i*1  i*1 

<  n  «xp{dn(dn  ||  k  ||  ^a-1)13-1  E|  e,  |b  J*j |  I'Jk  (^)  dz} 
i*1  11  n 

<  exp{c  dn(dn  Vn^'1) 

For  given  e  >  0.  when  n  is  large  enough. 


5 


P(l2  >  e)  <  e  dnCE(exp{dni2}) 


•e’dneE(  n  exp{Zj>)  <  e  2  nE. 


So.  we  have 


l  P(l2  >  e)  <  l  e2  n  < 


by  Boref-Cantelli  lemma 


Similarly,  it  is  true  that 


lim  sup  h  <.  0 
n-*®  * 


lim  inf  U  >.  0 
n-*'® 


Therefore 


b  ♦  0  a.s. 


Since  E|  6j  |p  <  ®,  we  know  that  £  P(|  e;  |  >  jp)  <  ®.  By  Borel-Cantelli  lemma  we  have 

1  n 

P(|  ej  >  ip,  i.o)  *  0.  Hence 


I  «pl(|  ej  |  >  iP)  <  <*>  a  s. 


Finally, 


1  >1  I2  "  I  l  <ei  -  ei>  /xj±_1an1|c  (*£*)  dzl^ 
i*1  " 


By  Schwartz  inequality. 


»1  I2  <  l  Ux|  ,an' )  k  (^aT-5)  d02  l  a2,<l  ai  I  > 
i-1  1  1  n  ix1 


